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IMAGE ENH ANCEMENT SYSTFM 

FIELD OF THE INVENTION 

The present invention relates to scan line doublers for increasing the 
number of apparent scan lines of a display device to reduce the visibility of the 
5 scan line structure of the picture image. More particularly, the present invention 
relates to a television, computer monitor or video projector scan line doubler 
which includes a method that overcomes the limitations of pixel interpolation by 
scan line averaging. 

BACKGROUND OF THE INVENTION 
10 When all other sources of error and distortion have been removed or 

minimised by correction or compensation, standard PAL or NTSO colour video 
images become limited In quality by perceptibility of the line scan structure. 

Subjective visibility of the line scan structure is a direct consequence of 
the limited number of horizontal scan lines in the standard composite picture, 
1 5 and is further a direct consequence of the field by field interlace. A conventional 
PAL television frame at 25HZ repetition rate is composed of two fields eg FO and 
Fi. Each field includes 312.5 scan lines, each of which are separated by an 
unilluminated strip or band. Successive fields are offset so that the scan lines of 
the next field occupy the unilluminated strips of the present field. This 
20 an-angement Is followed to minimize perception of 25Hz flicker in the resultant 
image. 

The need to increase the number of scan lines is particularly evident in 
the application of Field Sequential 3D. In this instance, odd lines of the video 
image are used to carry the left eye image and even lines the right eye image. 

25 Thus, after de-multiplexing, the image intended for each eye is at half the 
resolution of the original video standard. 

One approach to reducing the visibility of the line scan structure of the 
image calls for estimating, or interpolating, picture elements of additional scan 
lines from the picture elements already present in the picture image scanned in 

30 the conventional fomiat. This prior approach is known in the art as "scan line 
doubling" or "line doubling", and calls for doubling the number of scan lines from 
312.5 to 625 lines per field. Thus 625 lines are presented each 50th of a 
second. 



One prior approach to pixel interpolation is carried out by an intra-field or 
spatial domain process. The pixel for the unilluminated band between two scan 
lines Is derived as the average of the pixel amplitude and hue of the pixel in the 
scan line directly above and of the pixeMn the scan- line aireGtly-,below.. The-,. 
5 main drawback i©fathis-»appr©aGh"is the~i!edueed«res0li!itioroii0R»softi!res'»of the 
resultant picture-in the'>verticakdimensioni"at*edges^and sonneiipeFGeptible*25Hz»< 
vertical flicker in the instance of sharp vertical transitions^ within the- picture 
image. 

OBJECTIVES OF THE INVENTION 
1 0 A general objective of the present invention is to provide an improved 

method and apparatus for television scan line doubling and display. The 
invention overcomes a number of limitations of the line averaging techniques of 
prior art and may be simply implemented in readily available hardware or 
software. 

1 5 A more»*speGifiefcobje©tiwe»©f-the-invenli0ra^ Is toilncltidejt-iinet*idd;jwhereby 

the additional ipix©harmpliJtw#e»aad«lnue^Bnay4^ei!^e.te»^^ 
calculati©n«6r.alookupttablejiand«ap.pjBapba^^ of 
the overalUiniiag©,i«i»' 

Witmthe»»ab^©ve€©bjectiM(E>s«inwmindf thtr^pmse^^^^ a 
20 method of- determining anHnt©i?pFeted»^lihe"in aiin'eMdoiiibliiirgtfsystem^ including 
the steps of: 

determining the amplitude and hue of pixels on adjacent lines; 

determining the Root Mean Square (RMS) value of the amplitude and 
hue of the pixels on adjacent lines; 
25 utilizing the RMS value to create said interpreted line. 

The Root mean Square value may be calculated In hardware or software 
for each set of adjacent pixels. Alternatively, a lookup table could be used to 
approximate th#<Rd^t MsgiistteS^atret^aliiief*^ 

These and otheBrobjeets.-aspects, advantag^saandtfeatuReaiefithe prese 
30 inventien will bemi0Te''fuliriiyndeT«t€^©dwand..appjfe©iatedwap©w^ of 
the following d6talte#<«lescripti0n of ia prefgr&ed embodiment, presented in 
conjunction with the accompanying drawings. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 depicts a segment of a video image. 



Figure 2 depicts two tables showing average of two pixels, A and B, and 
the RMS of A and B. 

Figure 3 depicts a hardware Implementation of the invention. 
Figure 4 depicts a simplified hardware implementation of the invention. 
5 Figure 5 depicts the difference between two values A and B. 

Figure 6 depicts a lookup table based upon the difference between A and 

B. 

Figure 7 depicts a Pseudo RMS value of A and B. 
Figure 8 depicts the true RMS value of A and B 
0 DETAILED DESCRIPTION OF A PREFERRED EMBODIMENTS 

Figure 1 depicts a segment of a video image consisting of Field Zero line 
zero (FO), Field One line one (F1) and interpreted lines LO and LI. 

The individual pixels per line are indicated such that the first pixel on line 
one of Field 0 Is marked PF0,1 the second pixel PF0,2 and the nth pixel PFO.n. 
5 Similar terminology is used throughout the figure. 

The prior art has described one method of adding additional lines to an 
interlaced image by inserting an additional pixel having a value equal to the 
average of the value of the pixel In the line above and the pixel in the line below 
i.e. if the pixel above has a value A and the pixel below has a value B then the 
0 additional pixel will have a value equal to: 
New pixel = (A+B)/2 

The main shortcoming of this technique is that the resultant image tends 

to look softer or slightly out of focus. This is direct limitation of using a simple 

averaging technique. For example, if we consider a black and white image as 
5 the input source and the above line to be peak white and the below line to be 

black then the interpolated line will be grey. 

In order to overcome this limitation it is considered desirable to insert an 

Interpolated line containing pixels that are more closely associated with the 

luminance value of the brighter of the two pixels A and B. 
) In a preferred embodiment this invention discloses a new technique to 

achieve this by taking the Root Mean Square (RMS) of the values of A and B 

rather than the average. 



This is illustrated in figure 2 which contains two tables. The first table 
depicts A along the X axis and B along the Y axis and the average of A and B at 
the intersection. 

The second table depicts A along the X axis and B along^he Y axis and 
5 the RMS value>©f A and^B-at the interseeti©n!J^The-RMS"valuejis,Gal0ulated»fronri: 

By Gomparing^ the-Average and RMS^tdbles it is evident that: 

1 . When A = B, both mean and RMS process yield the same result; 

2. When A > B or B > A then the result is squewed closer to the larger 
1 0 value, which is the desired result. 

This RMS processing may be implemented in either hardware or 
software. A means of implementing the process in hardware is illustrated in 
figure 3. A pixel from a line in field FO and a corresponding pixel from the line 
below in F1 are both .passed . simultainiBsu^ 
15 each squarerds added and this result;^subsequently dividad-^by two. This 
IntermedtiirtciesuJt ha^yjs square rpojNftakpn and^he iresultitggSjjplue becomes 
the new pixel?* 

If the^image^b sber line dQuMtedlijs in tjoldur Ihen^he t^riigipiaPimage may 
well be in^RQB formatMlf this'^is the^caseithen^each of the-indivj and B 

20 values- wilNrequire^to>:be^pr0eessedMUsimgtthe*RMS^m hardware 
implementation will require six squaring circuits and three square root circuits. 
Both the squaring and square root functions are comparatively difficult to 
implement in hardware. It is therefore another objective of this invention to 
disclose an altemative preferred embodiment that enables an RMS value to be 
25 calculated in an efficient and effective manner. 

Figure 4 discloses an alternative preferred embodiment that simplifies the 
hardware implementation of the RMS process. 

Figure^4 depicts<ia^#Re*ad«^ ©nly^^M^mory (R©Mf that««requii?QS an input 
address and provides data^^output ^dependant^uppn theliinp.ut ^address. For 
30 illustrative.^purp©ses^onlyj^ortsider^theipixe|wal^ be^quantjsadtto 8 bits^i.e. 
256 individual levels. 

The quantised pixels PFO,n and PF1 ,n are used to form an address for 
the ROM. At each unique address is stored a byte that approximates to the 
RMS value of PFO.n and PF1,n. 



It is desirable that the RMS process can be implemented within an ASIC 
or FPGA. Using the ROM process of Figure 4, and assuming 8 bit RGB video 
then the number of input-output lines, external to the ASIC or FPGA, required to 
address the ROM's becomes excessive. Whilst a single ROM could be 
5 multiplexed across the R,G and B signals this may cause timing problems. In 
order to implement the RMS process within an ASIC or FPGA a simplified 
implementation is disclosed. 

An alternative preferred embodiment that simplifies the look up 
requirement such that the RMS process could be implemented within an ASIC 
1 0 or FPGA may operate as follows: 

Given above and below pixels A and B; 

If A < B then swap A and B such that A is always greater than or equal to 

B; 

If A = B then the new pixel = A; 
1 5 Take the difference between A and B; 

Use the difference to index into a lookup table; 
Add the value from the lookup table to B; 
Use this result as the value of the new pixel. 

In a practical implementation, comprising 8 bit RGB video, the lookup 
20 table would be contained in a ROM and the difference information would be 
used as the address, which would typically be 8 bits, of the data located in the 
ROM. Thus in this implementation the ROM would contain a maximum of 256 
addresses each containing an 8 bit value. 

Figures 5 through 8 Illustrate this simplified process as follows. In figure 
25 5 the A value is horizontal and the B value vertical. The table contains the 
difference between A and B where A > B or A = B. Note: In order to simplify the 
explanation A and B are assumed to take values of between 0 and 100 in steps 
of 10. 

In figure 6 the table depicts the value that would be stored in the lookup 
30 table for each difference between A and B. 

Figure 7 shows the effect of applying the previously disclosed method of 
approximating the RMS value of A and B. In this figure the A value is again 
horizontal and the B value vertical. The union of A and B within the table is the 
approximate RMS value of A and B, or a so called "Pseudo RMS" value. 



6 

If the results of figure 7 are compared with the true RMS values of A and 
B shown in figure 8 ( which has been rounded up to zero decimal places ) it will 
be seen that the percentage error in most cases Is small and not significant in 
this particular application. This is due. to the tacUhe eyejs-not seia^itive to small 
5 variations ^in -colourHor intemsity . 

The ^objective of this4nveiiitio%»is to«over«ome:«th&^preV'iouisl.yi^described 
shortcoiiinings of simplyAaddirag an^additie^malopixeltithat Is the-mean-©f A and B. 

This is a achieved by squewing the value of the additional pixel towards 
the larger value pixel. 
1 0 Since, in the preferred embodiments, the value of the additional pixel is 

determined by deriving the RMS value of two existing pixels from vertically 
opposed lines and the RMS value determined, either derived accurately or an 
approximation, from a lookup table, then the values contained within the lookup 
table can be altered to provide the most aesthetically^leasjog l^magjej.^ 
15 In a preferred embodiment, diffgrenHook up Mbles^«or'the*same lookup 

table with:*'diff6Fera,t weigh|lngSi->.could 'be* used depending .upfgct*the overall 
charaettFlstics^eif th© 'origipBl image*' 

Foriexannple, ^should 'tbe«overalNmage ; be^particOilaFlytdark^then it would 
be preferable^o use .interpolatexl''pixe:l:$»that are clbser^to the-'average value. 
20 Altemativelyr if the^ imatge^contains areas^of -high contPasli»thenwanr alternative 
table, or the same table with different weightings, may be used with values that 
enhance the contrast differences. 

It will be appreciated by those skilled in the art that these techniques may 
be applied to the whole image or selectively over the image such that different 
25 areas of the image may use different look up tables, or apply different 
weightings. The use of different tables or weightings could be determined by, 
but not limited to, brightness, contrast, colour, shading, hue, saturation, or 
marked differences between these'valuejs-over "the^imag© beingnpirocessed? 
Whilst the method and apparatus- of the preseniHnvention has been 
30 summarised and explained by an illifetrative^application in television line- 
doubling, it will be appreciated by those skilled in the art that many widely 
varying embodiments and applications are within the teaching and scope of the 



present invention, and that the examples presented herein are by way of 
illustration only and should not be construed as limiting the scope of this 
invention. 
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Figure 2 
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Figure 8 
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